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ABSTRACT 

Extending the earlier work of B. M. Byrne and P. 
Baron (1990) , the factorial invariance of the 21-item Beck Depression 
Inventory (BDI) was tested using 351 non-clinical adolescent males 
and 334 non-clinical adolescent females. All subjects were in grades 
9 through 12 and attended the same secondary school in a large 
metropolitan area in central Canada. Participants, who ranged in age 
from 12 to 18 years, completed the BDI and other assessment measures 
during one regular class period. All analyses were based on 
confirmatory factor analytic procedures within the framework of 
covariance structure modeling. Despite the differential loading 
pattern of Item 20 (hypochondria) for females, a three-factor 
structure that comprised one second-order general factor of 
depression and three first-order factors representing negative 
attitudes, performance difficulty, and somatic elements was found to 
be invariant across gender. Furthermore, except for two additional 
inventory items (items 8 and 10, self-accnsation and crying, 
respectively), the remaining BDI measurements were group-invariant. 
The results are expected to be of substantial interest to both 
researchers and clinicians whose concerns focus on depression as it 
affects adolescents. A 40-item list of references is included. Two 
data tables and two figures are provided. Items comprising the BDI 
are appended. (RLC) 
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Abstract 

Extending the earlier work of Byrne and Baron (1990), the 
factorial invariance of the Beck Depression Inventory (BDI) was 
tested across nonclinical adolescent males ( - 351) and females 
(£-334) using confirmatory factor analytic procedures. Despite 
the differer'ial loading pattern of Item 20 for females, a 
3-factor structure that comprised one 2nd-order general factor 
of depression and three lst-order factors representing negative 
attitudes, performance difficulty, and somatic' elements was 
found to be invariant across gender. Furthermore, except for 
two additional items (#8, #10), the remaining BDI measurements 
were group-invariant. Results are expected' to be of substantial 
interest to both researchers and clinicians whose concerns 
focus on depression as it bears on this population. 
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Measuring Adolescent Depression: Factorial Validity and 
Invarance of the Beck Depression Inventory Across Gender 

Although the Beck Depression Inventory (BDI; Beck, Ward , 
Mendelson, Mock, ft Krbaugh, 1961) was originally developed for 
use with clinical populations, a review of the literature 
reveals its popularity as a measuring instrument for 
nonclinical populations as well. In particular, the BDI has 
been used almost exclusively in the assessment of depression 
for nonclinical adolescents. Cross-validated findings from a 
recent factor analytic study of the BDI for this population 
(byrne & Baron, 1990) demonstrated strong support for an 
hierarchical structure consisting of one higher-order general 
factor of depression, and three lower-order factors 
representing Negative Attitudes, Performance Difficulty, and 
Somatic Elements. The present study extends the work of Byrne 
and Baron by testing for the equivalence of BDI item 
measurements and a second-order factorial structure across 
adolescent males and females. 

A frequent finding in epidemiological studies of depression 
is that adult females report a significantly higher rate of 
depression than males; a ratio of 2 to 1 has typically been 
found for both clinical and nonclinical samples (Hirschfield ft. 
Cross, 1982; No len-Hoeksema , 1987; Weissman & Klerman, 1977). 
Indeed, similar findings' have recently been reported for 
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adolescents ( Allgood-Mer ten , Lewinsohn, ft Hops, 1990; Baron ft 
Perron, 1986; Campbell, 3yrne, ft Baron, 1990; Reynolds, 1986; 
Rutter, Izard, S Read, 1986). 

Important assumptions in testing for gender differences in 
depression scores based on the BDI, however, are that (a) all 
item scaling units are equivalent across gender (i.e., all 
items are interpreted in exactly the same way by males and 
females), and (b) the factorial structure is equivalent across 
nales and females (i.e., relations among the facets of 
depression remain consistent across gender). Despite the fact 
that violation of these assumptions clearly invalidates 
interpretations based on mean score differences, no study to 
date has tested the. validity of these equivalencies. 

in this regard it may be, as demonstrated in recent 
construct validity research related to adolescent self-concept, 
(Byrne, 1990; Byrne & Shavelson, 1987), that interrelations 
among the facets of depression vary somewhat for adolescent 
males and females. Furthermore, it "is possible that a different 
pattern of items defines the underlying factorial structure of 
the BDI for each sex. Such findings would suggest either a 
differential perception of item content, or a differential 
nomological network of depression structure across gender. 
These questions bear on the construct validity of adolescent 
depression and can be formulated into hypotheses that can be 
tested statistically. This was the task of the present study, 



BDI Gender Tnvariance 



5 

as it related to the factorial structure of the DDI proposed by 
Byrne and 3aron ( 1990) . 

Building upon the earlier work of Tanaka and Huba (1984), 
Byrne and Baron (1990) used confirmatory factor analyses (CFAs) 
within the framework of covariance structure modeling to test 
the validity of a 2nd-order structure. In contrast to Tanaka 
and Huba, whose validity work was based on clinical adult d3ta, 
Byrne and Baron used three independent samples of nonclinical 
adolescents (mean age=15 yrs) to test for, and cross-validate 
the factorial validity of the BDI . Consistent with the Tanaka 
and Huba findings, Byrne and Baron found an hierarchical 
factorial structure to most adequately represent the data, 
albeit certain item loadings differed for the clinical and 
nonclinical populations. On the basis of their cross-validated 
findings, Byrne and Baron concluded that the underlying 
structure of BDI responses comprises one 2nd-order general 
factor of depression, and three lst-order factors which they 
labelled Negative Attitudes, Performance Difficulty, and 
Somatic Elements. This model is presented schematically in 
Figure 1 . 

Insert Figure 1 about here 

Except for the work of Byrne and Baron (1990), all previous 
factor analyses of the BDI, as they relate to the nonclinical 
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adolescent population, have used exploratory (RFA) procedures 
involving principal components analyses with varimax rotacion. 
Findings from this research, however, have been inconsistent; 
2-factor (Shek, 1990), 3-factor (Baron P« LaPlante, 1984), and 
4-factor ( feri , 1932) solutions have been reported. This 
discordance can be linked to the widely known limitations 
associated with RFA procedures in general (e.g., 3ollen, 1989; 
Long, 1983), and prin :ipal components analyses in particular 
(e.g., Borgatta, Kercher, 9 < Stull, 1986; Gorsuch, 1990; Hubbard 
X Allen, 1987; Snook & Gorsuch, 1989). 

The present study addressed the methodological weaknesses 
of previous factor analytic and gender difference research by 
assessing the equivalency of BDI measurement and structure 
across adolescent males and females based on a rigorously 
tested and cross-validated factorial model. All analyses were 
based on CFA procedures within the framework of covariance 
structure modeling. 

Method 

Sample and Procedures 

The data comprised BDI responses from 685 (males, £-351; 
females, £=334) adolescents (grades 9-12) attending the same 
secondary school in a large metropolitan area in central 
Canada. Participants ranged in age from 12 to 18 years (M=15 
years), Only questionnaires with complete data were included in 
the analyses. 
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Subjects completed the BDI , along with other assessment 
measures, during one regular class period; all testing 
materials were completed anonymously. Test instructions were 
paraphrased by the test administrator, and procedural ques xons 
were solicited and answered. All participation, in keeping with 
school and Ethics Committee policies, was voluntary and no 
incentives were offered. 
Instrumentation 

The BDI is a 21-item scale that measures symptoms relatec 
to cognitive, behavioral, affective, and somatic components of 
depression. Although originally designed for use by trained 
interviewers, it is now most typically used as a self-report 
measure (Beck, Steer, & Garbin, 1988; Kearns, Crrickshaw, 
McGuigan, Riley, Shaw, & Snaith, 1982; Vredenburg, Krames, ft 
Flett, 1985). For each item, respondents are presented with 
four statements rated from 0 to 3 in terms of intensity, and 
asked to select the one which most accurately describes their 
own feelings; higher scores represent a more severe level of 
reported depression. Total scores range from 0 to 63 and are 
used to categorize four levels of depression: none to minimal 
(0-9), mild to moderate (10-18), moderate to severe (19-29), 
and severe (30-63) (Beck et al., 1988). Zero-rated statements 
for BDI items are presented in the Appendix. 

Previous research has demonstrated the BDI to be 
psycho metrically sound in measuring depression for nonclinical 
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adolescents. Tests for the internal consistency rep-'ility of 
the BDI for this population have revealed alpha coefficients 
ranqin« from .30 to .00 (mean a =.36; 3aron ft Laplante, 1934; 
3arrera ?i Garrison-Jones, 1988; Shek, 1990; Teri, 1932). A 
ties t-retest reliability coefficient of .74 has also been 
reported (3aron & LaPlante, 1984). Additionally, Barrera and 
Garrison-Jones have demonstrated evidence of convergent 
validity with the Child Assessment Schedule (CAS; Hodges, 
Kline, Stern, Cytryn, 5 McKnew, 1982) for items measuring 
depression symptoms (£=.73) and with the General Self-worth 
subscale of the Perceived Competence Scale for Children 
(Harter , 1982 ; £=-.64); they also reported evidence of 
discriminant validity with CAS items measuring conduct disorder 
(£=.29) and anxiety (£=.29) symptoms. 
Data Analyses 

Data were analyzed in two stages. First, the 3~factor 
2nd-order structure proposed by Byrne and Baron (1990) was 
tested separately for goodnes s-o f ~ f it to male and female data. 
Because it is important that the model for each sex be 
well-fitting before testing for equivalencies of measurement 
and structure across the two groups, model respecif ication was 
conducted if there was statistical and theoretical 

l 

justification for doing so. Once the baseline model was 
determined for each sex, the equivalence of item measurements 
and factorial structure was tested across males and females* 
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Cognizant of caveats related to tests for partial measurement 
procedures (see Byrne, Shavelson, 3 Muthen, 1989), equality 
constraints were imposed on only those parameters similarly 
specified for both qroups. 

Assessment of model fit was based on multiple criteria tl<at 
reflected statistical, theoretical, and practical 

2 

considerations; these included (a) the X likelihood ratio, (b) 
the Tucker-Lewis index (TLI; Tucker % Lewis, 1973), (c) the 
relative noncentrality index ( RNI j McDonald & Marsh. 1990). (d) 
the adjusted goodness-of -f it index (AGFI), t-values (parameter 
estimates relative to their standard errors of estimate), and 

2 

modification indices (Mis), all provided by the LISREL VI 
computer program (Joreskog & Sorbom, 1985), and (e) the 
substantive meaningf ulness of the model (see MacCallum, 1986; 
Suyapa, Silvia, & MacCallum, 1988). Criteria indicative of 
adequate model fit weie values >.90 for the TLI and RNI, and 
>2.00 for the t-values. 

Results 

Determination of Baseline Models 

Tor adolescent males, as indicated in Table 1, the 
hypothesized 3-factor hierarchical model cf depression 
represented a reasonably good fit to the data; all parameters 
were statistically significant. (Model 0 argues that each item 
represents a factor, and provides the null model required for 
computation of tie TLI and RNI.) A review of the Mis, however, 
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indicated that model respecif ication could yield a 
significantly better fit. if Item 12 (loss of interest in other 
people) were free to cross-load onto the Somatic Elements 
factor (MI=16.75); reestination yielded a statistically 
nonsignificant cross-loading (t=.429). More importantly, 
however, we could provide no theoretical rationale for this 
parameterization. Thus, the originally hypothesized factorial 
•nodel was considered optimal in representing the BDI for 
adolescent males. 



Insert Table 1 about here 



For adolescent females, on the other hand, model fit for 
the initial parameterization was somewhat less well-fitting 
(see Table 1). Furthermore, one item (#19, measuring weight 
loss) was found to be nonsignificant (t=.690), and a review of 
the Mis revealed two parameters to be worthy of estimation. The 
more prominent fixed parameter (MI»24.05) represented an error 
correlation between Item 20 (concern for health) and Item 21 
(interest in sex), while the other (MI=12.65) represented the 
cross-loading of Item 20 onto the Negative Attitudes factor. 
Three additional models were therefore specified and estimated; 
as shown in Table 1, all yielded highly significant 
improvements in model fit? The first of these post hoc models 
(Model 2) specified an error correlation between Items 20 and 
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21, the second (Model 3 )• specified, additionally, that Item 20 
cross-load onto the Negative Attitudes factor, and the third 
(So del 4), that Item 20 load on the Negative Attitudes factor, 
rather than on the Performance Difficulty factor. As shown in 
Table 1, goodness-of-f it for Models 3 and 4 were almost 
identical; given these results, parsimony was the key element 
in choosing between Models 3 and 4. For statistical, 
psychometric, and theoretical reasons, then, Model 4 was 
considered to be the most plausible in representing BDI data 
for adolescent females. Baseline models representing the data 
for males and for females are presented schematically in Figure 
2. 



Insert Figure 2 about here 
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Determination of Factorial Invariance 

Tests for invariance were carried out in two stages. First, 
all item measurements were tested for their invariance across 
males and females. Once it was determined which items were 
operating equivalently across groups, these items were 
constrained equal and a 2nd-order structure linking the three 
lst-order factors to general depression was tested next for its 
invariance across gender. (For a more detailed discussion and 
description of CFA applications using LISREL modeling, see 
Byrne, 1989.) 
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These analyses involved first specifying a model in which 
all lst-order factor loadings were constrained equal across 
samples, and then comparing that model with a less restrictive 
one in which these parameters were free to take on any value. 
As with model testing noted earlier, the difference in fit 
between the two nested models provides a basis for determining 
the tenability of the hypothesized equality constraints; a 
significant X 2 indicates noninvar iance , and thus rejection of 
tne hypothesis. Turning to Table 2, we see that the comparison 
of Model 2 (in which these parameters were constrained equal) 
with Model 1 (in vhich they were free to vary), yielded a 
highly significant A X* (37.24, £<.001), thereby substantiating 
rejection of the hypothesis of invariant item measurements 
across males and females. 



Insert Table 2 about here 
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Since this result indicated that certain BDI items were 
gender-specific in their measurement of lower-order facets of 
depression, the next task was to identify these noninvariant 
items; this required the specification of six additional 
models. Models 3, 4, and 5 tested separately for the invariance 
of items measuring Negative Attitudes, Performance Difficulty, 
and Somatic Elements, respectively; all items comprising the 
latter two factors were found to be equivalent across gender. 
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Thus, to pinpoint which items related to the Negative Attitudes 
factor were contributing to the inequality of measurement, 
tests for invariance were conducted separately for each item. 
(Because Item 20 was known to operate differently for males and 
females, it was never constrained equal across groups; see 
ayrne et al., 1989.) As indicated in Table 2, these analyses 
revealed Items 8 and 10 not to be equivalent across gender. 

Having identified the items that were operating 
equivalently for males and females, we next specified a model 
in which these lst-order loadings, and the three 2nd-order 
loadings were constrained equal (Model 7). This model was 
compared with Model 6 in which the 2nd-order loadings were 
unconstrained. The comparison yielded findings that were not 
significant ( A X 2 (3)=6.03, £>.05), thereby supporting the 
equivalence of an hierarchically-ordered factorial structure 
across adolescent males and females. 

Discussion 

In testing first for the validity of a 3-factor 2nd-order 
structure of depression for adolescent males and females, as 
initially hypothesized by Byrne and Baron (1990), we found a 
differential factor loading pattern related to Item 20 
(hypochondria) for females; additionally, a substantial 
correlated error between Items 20 and 21 (libido loss) was 
evidenced only for females. That these findings should be 
present for adolescent females, and not for adolescent males, 
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is both interesting and substantively reasonable. Error 
correlations between item-pairs are usually an indication of 
perceived redundancy in item content. For adolescent females, 
then, it appears that Items 20 and 21 elicit responses 
reflective of the same mental set. Considering the degree of 
social attention accorded sexually-transmitted diseases in 
general, and AIDS in particular in recent years, it is not 
surprising that young people develop health concerns relative 
to sexual activity. Of particular relevance is the fact that 
caveats conveyed by various media have focused more on young 
females than on young males. 

Relatedly, Rierdan, Koff, and Stubbs (1987, 1988) have 
noted that adolescent females tend to exhibit lower levels of 
body self-image than their male counterparts. This finding may 
well explain the loading of Item 20 on the Negative Attitudes 
factor, rather than on the Performance Difficulty factor, as 
was the case for males. Another possible explanation of this 
differential loading pattern might'be that health complaints 
are more stongly linked to performance difficulty for males 
than for females . 

Tests for invariance revealed that Item 8 (self-accusation) 
and Item 10 (crying) were not measuring the factor of Negative 
Attitudes equivalently for adolescent males and females. One 
possible explanation for the nonequivalency of Item 8 might lie 
with differences in depressive experiences across gender. For 



15 



3DI Gender Invariance 

15 

example, Blatt and Shichman (1986) have identified two types of 
depressive experiences self-critical and dependent; research 
has shown the self -critical style to be unrelated to femininity 
(Welkowitz, Lish, fi Bond, 1985). Moreover, these findings may 
also explain why the factor loading is much higher for males 
(.55) than for females (.38). 

The differential measurement of Negative Attitudes for Item 
10 could be linked to social reinforcement factors. Because it 
is more socially acceptable fcr females to cry than males, it 
may well be that females are therefore more apt to express 
symptoms of depression (i.e., manifested in negative attitudes) 
in this manner. Consistent with socially prescribed gender 
roles, the loading of crying onto the Negative Attitudes factor 
is higher for females (.48), than it is for males (.30). 

One limitation of the present study was the use of maximum 
likelihood (ML) estimation procedures, in light of some 
nonnormali ty in the data for both males and females. Although 
the estimates were likely unaffected, it is possible that the 
t-values were inflated as a consequence of downwardly biased 
standard errors (Muthen & Kaplan, 1985; Sharma, Durvasula & 
Dillon, 1989). However, since the hypothesized model of BDI 
factorial structure used in the present study was based on the 
Byrne and Baron (1990) parameterization as derived from ML 
estimation, we considered it important to maintain consistency 
with the previous CFA study. Analyses based on asymptotic, 

ERjC 1D 



BDI Gender In variance 

16 



rather than on normal distributional properties, may yield a 
slightly different factorial structure* However, further factor 
analytic research bearing on use of the BDI with nonclinical 
adolescents is necessary to examine this possibility. 

Conclusion 

Although results of the study confirmed the hypothesized 
hierarchical structure of the BDI and determined the equality 
of theoretical relations among the three facets of depression 
for adolescent males and females, three measurement-related 
differences were found: (a) Item 20 was found to load on the 
Negative Attitudes factor, rather than on the Performance 
Difficulty factor for females only, and (b) Items 8 and 10 were 
found to be nonequivalent in their measurement of Negative 
Attitudes across gender. Hcwever, the fact that our rigorous 
testing of the BDI yielded only three gender-specific 
differences is truly remarkable, and speaks well for use of the 
BDI with nonclinical adolescents* These results should be of 
substantial interest to researchers and practitioners alike. 
Indeed, our findings should bear importantly on future research 
that focuses on methodological issues related to use of the BDI 
with nonclinical adolescents, and on substantive issues 
involving multigroup comparisons across gender. From an applied 
perspective, findings carry important implications both for the 
application of the BDI, and for the interpretation of its test 
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scores relative to the nonclinical adolescent population. In 
particular, practitioners are urged to be cognizant of the 
gender specificity associated with Item 8 (self-accusation). 
Item 10 (crying), and Item 20 (hypochondria). 
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Appendix 

Items Comprising the Beck Depression Inventory 8 



ERIC 



1 . I do not feel sad 

2. I am not particularly discouraged about the future 

3. I do not feel like a failure 

4. I get as much satisfaction out of the things as I used to 

5. I don't feel particularly guilty 

6. I don't feel I am being punished 

7. I don't feel disappointed in myself 

8. I don't feel I am any worse than anybody else 

9. I don't have any thoughts of killing myself 

10. I don't cry any more than usual 

11. I am no more irritated now than I ever am 

12. I have not lost interest in other people 

1 3. I make decisions about as well as I ever could 

14. I don't feel I look any worse than I used to 

15. I can work about as well as before 

1 6. I can sleep as well as usual 

17. I don't get more tired than usual 

1 8. My appetite is no worse than usual 
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19. I haven't lost much weight, if any lately 

20. I am no more worried about my health than usual 

21 . I have not noticed any recent change in my interest in sex 



* Only the first of four statements for each item is presented here. 
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Footnotes 

1 . A baseline model is the most parsimonious, albeit best-fitting and most substantively 
meaningful model to represent the observed data. 

2. An M! can be computed for each constrained parameter and indicates the expected 
decrease in % 2 W the parameter were to be relaxed; the decrease, however, may 
actually be higher. Only Ml values > 5.00 were considered since smaller values 
indicate little appreciable improvement in model fit (see Joreskog & Sorbom, 1995). 

3. Nested models can be compared with one another by computing the difference in 
their % 2 values and degrees of freedom; this % 2 difference is itself x 2 - distributed with 
degrees of freedom equal to the difference in degrees of freedom. 
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Table 1 

Summary of Model Fit Statistics for Males and Females 

Model % 2 df AGFI TU RNI 



Males 

0 Null Model 1679.73 210 

1 Hypothesized 3 i 6.77 187 .91 .90 .91 
Model 



Females 

0 Null Model 1592.28 210 

1 Hypothesized 355.87 187 .89 .86 .88 
Model 

2 Error correlation 331.13 186 .89 .88 .90 
between items 

20/21 

3 Item 20 cross- 314.26 185 .90 .89 .91 
loaded on F/ 

4 Item 20 loaded nn 315.45 186 .90 .89 .91 
F 1t instead of F 2 



F, » Factor 1 (Negative Attitudes) 
F 2 = Factor 2 (Performance Difficulty) 
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Table 2 

Summary of Tests for Invariance Across Males and Females 



Model 



df 



Model Ax' 
Comparison 



Adf 



1 Baseline 
Multigroup model 

2 Pattern of item 
loadings invariant 8 

3 Item loadings 
for F, invariant 

4 Item loadings 
for F 2 invariant 

5 Item loadings 
for F 3 invariant 

6 All item loadings 
except #8 and 
#10 invariant 13 



632.22 



669.46 



655.96 



639.45 



638.49 



654.31 



373 



390 



382 



378 



376 



388 



2 vs 1 37.24*** 



3vs1 19.74** 



4 vs 1 



5 vs 1 



7.23 



6.27 



6 vs 1 22.09 



17 



15 



7 Model 6 with 
all 2nd-order 
loadings 
invariant 



660.34 



391 



7vs6 



6.03 



** p < .01 *** p < .001 

a Item #20 was not constrained equal across gender. 
b Equality constraints were imposed separately for each item loading. 

.2 tut :« . 2 



Ax - difference in % values; Adf = difference in degrees of freedom. 
F, = Factor 1 (Negative Attitudes) 
F 2 = Factor 2 (Performance Difficulty) 
F 3 » Factor 3 (Somatic Elements) 
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Figure Captions 

Figure 1 . Hypothesized 2nd-order Factorial Structure of the Beck Depression 
Inventory for Nonclinical Adolescents (Byrne & Baron, 1990). 

Figure 2 . Standardized Estimates for 2nd-order Factorial Structure of the Beck 
Depression Inventory for Nonclinical Adolescent Males and Females. 
Parenthesized values represent critical ratios of estimates; values > 1 .96 
indicate statistical significance (p. < .05). Values in boxes represent item 
numbers. 

* denotes parameter fixed to 1 .0 in the original solution for purposes of 

statistical identification 
** denotes noninvariance across gender. 



DEPRESSION 



NEGATIVE 
ATTITUDE 



PERFORMANCE 
DIFFICULTY 



/ 



SOMATIC 
ELEMENTS 



1 SADNESS 



2 PESSIMISM 



FAILURE 



GUILT 



6 PUNISHMENT 



7 SELF-DISLIKE 



8 SELF-ACCUSATION 



SUICIDAL 



10 CRYING 



14 SELF-IMAGE 



4 DISSATISFACTION 



11 IRRITABILITY 



12 WITHDRAWAL 



13 INDECISIVENESS 



15 WORK INHIBITION 



17 FATIGUE 



20 HYPOCHONDRIA 



16 INSOMNIA 



18 APPETITE LOSS 



19 WEIGHT LOSS 



21 LIBIDO LOSS 



30 



:> 

t — 
m 

CO 




> 

I — 
m 

go 



ERLC 




31 BEST COPY AVAILAfil F 



